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Abstract 

We establish the Schwarz Reflection Principle for J-complex discs attached to 
a real analytic J-totally real submanifold of an almost complex manifold with real 
analytic J. We also prove the precise boundary regularity and derive the precise 
convergence in Gromov compactness theorem in C'^''^-classes 0- 

1. Introduction 

1.1. Reflection Principle 

Denote by A the unit disc in C, by S - the unit circle. Let /3 C S be a non-empty open 
subarc of S. 

Theorem 1 (Reflection Principle). Let {X,J) be a real analytic almost complex manifold 
and W a real analytic J-totally real submanifold of X. Let u : A — > X be a J-holomorphic 
map continuous up to (3 and such that u{[3) C W . Then u extends to a neighborhood of 13 
as a (real analytic) J-holomorphic map. 

The case of integrable J is due to H. A. Schwarz [Swj . Indeed, one can find local 
holomorphic coordinates in a neighborhood of u{p) for a taken p & (3 such that W = M" 
in these coordinates and now the Schwarz Reflection Principle applies. In our case there 
is no such reflection, since a general almost complex structure doesn't admits any local 
(anti)-holomorphic maps. But the extension result still holds. 

One can put Theorem 1 into a more general form of Caratheodory, ^Caj. For this recall 
that the cluster set cl(u,/5) of m at consists of all limits lim^^oo w(Ca;) for all sequences 
{Ck} C A converging to /?. In |CGS] it was proved that if the cluster set cI(m,/5) of a 
J-holomorphic map m : A — A is compactly contained in a totally real submanifold W 
then u smoothly extends to f3. Therefore we derive the following 

Corollary 1. In the conditions of the Theorem 1 the assumption of continuity of u up to 
(3 and u{f3) C W one can replace by the assumption that u{A) is compact and the cluster 
set c\{u,P) is contained in W. 

^Key-words: almost complex structure, totally real manifold, holomorphic disc, reflection principle. 



1 



Introduction 



2 



1.2. Boundary Regularity 

For the proof of our Reflection Principle we need to study not only real analytic boundary 
values but also the smooth ones (with finite smoothness). For our method to work we 
need the precise regularity and a certain kind of uniqueness of smooth J-complex discs 
attached to a J-totally real submanifold. The result obtained is the following 

Theorem 2 (Boundary Regularity). Let u : (A,/?) (X,W) be a J -holomorphic map of 
class L^'2nC°(AU/9), where W is J-totally real. Then: 

(i) for any integer k ^ and real 0<a;<l if J E C'^'" and W G C^^^^'^ then u is of 
class C'=+^'" on AU/5; 

(ii) for k ^ 1 the condition u G L-"^'^ fl C°(A U /3) and u{(3) C W can he replaced by the 
assumption that u{A) is compact and the cluster set cI(m,/3) is contained in W . 

Remark 1 If J is of class C° and of then m G up to for all < a < 1. This 
was proved in [IS2j . Lemma 3.1. 

For integrable J the result of Theorem 2 is due to E. Chirka |Ch] . For non-integrable 
J weaker versions of this Theorem were obtained in |CGSl IGSl IMS] . Namely, the C'^'"- 
regularity of u up to /3 was achieved there under the same assumptions. The precise inner 
regularity was obtained by J.-C. Sikorav in |Skj . 

1.3. Compactness Theorem 

The precise regularity of J-complex discs attached to a J-totally real submanifolds of 
Theorem 2 allows also to get the precise convergency in Gromov compactness theorem. 
We refer to the Subsection 6.1 and to [ISll IIS2j for the relevant notions and definitions. 

Theorem 3 (Compactness Theorem). Let a sequence {Jn} of almost complex structures 
of class C^'°' , k ^ 0,0 < a < 1, on a Riemannian manifold {X,h) converge on a compact 
subset K <Z X in C^'"- -topology to an almost complex structure J. Let a sequence Wn = 
{{Wi, fn,i)}iLi of Jn-totally real immersed submanifolds of X of class C^"*"^'" converge in 
C^+^'^ -topology to a J-totally real immersion W = {{Wi, fi)}^^. Suppose that all Wn 
and W have only weak transverse self-intersections. Let furthermore, {{Cn,Un)} be a 
sequence of stable Jn-complex curves over X , parameterized by a fixed oriented compact 
real surface with boundary S = such that: 

i) Un{Cn) C K and that there exists a constant M such that area['U„(C„)] ^ M for all 

n; 

h) [Cn-iUn) satisfy the totally real boundary conditions (W^„,/3,'Un'*) with u"n\{l3i) C Wi 
for all n and i. 

Then there exits a subsequence {(C'„j.,u„j,)} o/{(Cn,M„)} and parametrizations an,. '■ 
S — »• Cn,,, such that (C„^,M„^,cr„j.) converges in 0^^^'°" -topology up to boundary to a sta- 
ble J-complex curve {C,u,a) over X and this {C,u) satisfies the totally real boundary 
conditions {W,(3,u^''^) with some C''^^'" -continuous maps u\: jdk ^Wi. 

The novelty here with respect |MSl IF] is that there is no loss in both of regularity and 
convergency of curves up to the boundary. In [IS2j an analog of Theorem 3 was proved 
for the special case k = a = 0. 
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1.4. Proofs 

The interior analyticity of J-holomorphic discs in analytic almost complex manifolds 
follows from classical results on elliptic regularity in the real analytic category, see, for 
instance, [BJSj . However the real analyticity up to the boundary is not a consequence of 
the known results since we do not deal with a boundary problem of the Dirichlet type. The 
direct application of the reflection principle (in the form of Vekua, for example) also leads 
to technical complications because of the non-linearity of the Cauchy-Riemann operator 
on an almost complex manifold. So our approach is different and is based on the reduction 
of the boundary regularity to a non-linear Riemann-Hilbert type boundary- value problem. 

This paper is organized in the following way. 

1. In §3, using [IS2j and |GSj we prove Theorem 2. First we establish the '"-regularity of 
M if J G and then, using a sort of "geometric bootstrap" , we obtain the C'^"'"^'"-regularity 
of M if JgC'^'". 

2. In §4 we prove the solvability and uniqueness of a Riemann-Hilbert type boundary- 
value problem in Sobolev classes - the principal new tool of this paper. In §5 we adapt 
this method to the real analytic case. Then the uniqueness, both in Sobolev and in 
real analytic categories gives the proof of the Reflection Principle of Theorem 1. The 
novelty in §4 and 5, is a non-standard choice of the smoothness classes and an application 
of the Riemann-Hilbert boundary-value problem in the resolving of boundary regularity 
questions. 

3. In §6 we recall necessary notions and prove the Compactmess Theorem. 

4. We end up with the formulation of open questions in §7. 

We would like to express our gratitude to J.-F. Barraud who turned our attention to 
the question of extendability of J-holomorphic maps through totally real submanifolds in 
real analytic category. 

2. Preliminaries 

In what follows {X, J) will denote a pair which consists of a real analytic manifold X and 
an almost complex structure J on it. Note that by the well-known theorem of Whitney 
any smooth manifold can be endowed with a compatible atlas with real analytic transition 
mappings, i.e., the condition of real analyticity of X doesn't leed to any loss of generality. 
The regularity of J will be specified in each statement. By J^j = i\d denote the standard 
complex structure of C" (as well as of C and of A). Everywhere throughout the paper we 
use the notation L^'^ for Sobolev space of functions with generalized partial derivatives of 
class up to the order k. A C^-map (or (1 L^^l-map) u : A —>■ X is called J-holomorphic 
if for every (or almost every) C ^ ^ 

du{OoJ,t = J{u{0)odu{() (2.1) 

as mappings of tangent spaces T^A T„(^)X. The image u{A) is called then a J-complex 
disc. Every almost complex manifold (X, J) of complex dimension n can be locally viewed 
as the unit ball B in C" equipped with an almost complex structure which is a small 
deformation of Jst- To see this fix a point p & X, choose a coordinate system such that 
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p = 0, make an R-linear change of coordinates in order to have J(0) = Jgt and rescale, i. 
e., consider J{tz) for t > small enough. Then the equation (12. ip of J-holomorphicity of 
a map u : A ^ B can be written in local coordinates ^ on A and z on C" as the following 
first order quasilinear system of partial differential equations 

u^-Aj{u)u-^=0, (2.2) 

where Aj(z) is the complex nxn matrix of the operator whose composite with complex 
conjugation is equal to the endomorphism {Jst + J{z))~^{Jst — J{z)) (which is an anti- 
linear operator with respect to the standard structure Jgt)- Since J(0) = Jgt, we have 
Aj{0) = 0. So in a sufficiently small neighborhood of the origin the norm || Aj ll^oo is also 
small which implies the ellipticity of the system (12.21) . 

We recall some classical integral transformations. Let Q he a relatively compact do- 
main in C bounded by a finite number of transversally intersecting smooth curves. Denote 
by T^^ the Cauchy-Green transform in Q: 



Denote also by 



the Cauchy transform. 



Proposition 2.1 For every integer k > 0, real < a < 1 and real p > 1 the following 
holds: 

(i) : C'='°(n) — > C*^+i'"(n) (resp. Tg^ : L'='P(^]) — > L^+^^p{Q)) is a hounded 

linear operator and {T^^h)-^ = h for any h G C^'"(fi) (resp. for any h G L^'^{Q) ). 

(a) Let h be a bounded real analytic function on Q, then T^'^h is real analytic on 
VL. If, furthermore, fl = A, h is a sum of a converging series h{(,Q = Hh^^iQ^Q and is 
continuous up to the boundary dA, then for any ( E A we have 

T^''h{0 = H{CX)-{K^H){0, (2.5) 
where H is a primitive of h with respect to (. 

The proof of (i) is contained, for instance, in jVe] , Theorems 1.32 and 1.37. For the 
statement (ii) about real analyticity see |Ve] . p. 26. Relation (12.51) is in fact nothing but 
the Cauchy-Green formula. We shall also need the Schwarz integral transform on A: 

Denote by 0^'"(fi) (resp. O^'P(fi)) the Banach space of holomorphic maps g : — > C" 
of class C^'"(r2) (resp. L^'P{fl)). This space is equipped with the norm || g ||cfe.Q(n) (resp. 
II 9 llL''-.p(n))- 
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Proposition 2.2 T^^ : C'='"(S) — > 0'='°(A) (resp. T^^ : L^'P(S) — > 0^^p{A)) and Kn : 
— > (^resj). : L^'P((9fi) — > are bounded linear operators. 

For any real-valued function ip G C'^'"(S) one has 

Re(T^'^^)|s = ^ (2.7) 

and 

lm(T^^^/')(0) = 0. 

For the proof see, for instance, [Vej . Theorem 1.10. 

We shall need to consider the space of traces of functions from L^''p{A) on the unit 
circle S, see |Moj . We say that a function defined on S is in the space T^'^(S), p > 2, if 
there exists a function u G L^'^(A) such that u\s = (p- Let us point out that by the Sobolev 
imbedding we have T^'^(S) C C"(S) with a = {p — 2)/p. On the other hand if 1/2 < a < 1 
then C"(S) C T^'^(S) for every p < (1 — a)^^. Indeed, given G C"(S) its Schwarz integral 
u = T^^cj) is of class 0"(A) and so by the classical theorem of Hardy-Littlewood, see 
[Moj . one has 



du{C) 



dc 



c 

< 



:i-\c\y~ 



This implies that G L'p{A) for p(l — a) < 1. Now the Poisson integral 

P(f):=ReT^^{Re<f)) + iReT^^{\m(f)) {2.t 
gives an extension of (f) of class L^'^(A). 
Proposition 2.3 If^eT^'^iS) then T^^ (p e L^'P{A) . 



Proof. Let u G L^'^(A) be an extension of 0. By the Cauchy-Green formula 

« = i^A0 + T^%. (2.9) 

Hence the Cauchy type integral in the right hand (and therefore the Schwarz integral) is 
of class L^'P(A), which proves the proposition. 

□ 

Finally, we introduce the norm on the space T^'P(S) by setting 

HWt^.p ■= II^0|Ili,p(A) 

where P0 denotes the Poisson integral (12. 8p . Obviously, T^'P(S) is a Banach space. It 
follows from fl2.8p that the convergence in C"(S), a > 1/2 implies the convergence in 
T^'P(S), i.e., C"(S) is a closed subspace in T^'P(S). Furthermore, if a sequence of functions 
{un} converges in L^'^, then their traces 0„ := Un\s converge in T^'^(S). This follows from 
the Cauchy-Green representation (12.91) since the convergence of the Cauchy type integral 
implies the convergence of the Schwarz and Poisson integrals. 
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Remark 2 In conclusion of this section we point out that the notion of the trace space 
T^'P{dQ) on the boundary of a domain Q can be extended to a much larger class of 
simply connected domains by means of the Riemann mapping theorem and the classical 
theory of boundary properties of conformal mappings. For instance, all above definitions 
and properties admits an immediate generalization to the case where A is replaced by a 
simply connected domain bounded by a finite number of real analytic arcs with transversal 
intersections. The special case of the upper semi-disc will be important for our 
considerations. In what follows we simply write T^'^ in the case of the unit circle. 

3. Boundary Regularity in Holer Classes 

In this section we shall first use a version of a Reflection Principle proposed in |IS2j to 
prove the case k = of Theorem 2. Then using the "geometric bootstrap" from |GSj 
we obtain C*^"'"^'"-regularity of complex discs in C*^'"-regular structures for all k ^ 1, thus 
proving the Theorem 2. 

3.1. Reflection Principle- 1 

In this subsection the structure J is supposed to be of class only. A J-totally real 
submanifold W of X will be supposed to have '"-regularity. Similarly to the integrable 
case, a real submanifold W of an almost complex manifold {X,J) is called J-totally real 
if TpW (1 J (TpW) = {0} at every point p of W. If n is the complex dimension of X, then 
any totally real submanifold of X is locally contained in a totally real submanifold of real 
dimension n. So in what follows we assume that W is n-dimensional. 

First we make a suitable change of coordinates. 

Lemma 3.1 One can find coordinates in a neighborhood V of p E W such that in these 
coordinates V = R'^'', W = W\ J|Rn = J,t and J{x,y) - Jst = 0{\\y\\''). 

Proof. After a change of coordinates of class C^'" we can suppose that in some neigh- 
borhood of p = our manifold W coincides with M". Next we are looking for a C^'"- 
diffeomorphism (p = {ipi, ...(p2n) in a neighborhood of the origin such that 

1) ipj{x,0) =Xj for j = l,...,n; 

2) ipj{x,0) = for j = n + l,...,2n; 

3) ^(x,0) = J(x,0) (^) forj = l,...,n. 

Such C^'"-diffeomorphism exists due to the Trace theorem, see In new coordinates 
given by ip we shall clearly have W = M", J|]Rn = J^t and J{x,y) — Jst = 0{\\y\\") due to 
C^-regularity of J. 

□ 

In what follows the disc A with an arc f3 on its boundary S will be suitable for us 
to change by the upper half-disc A+ = {( : Re( > 0} and the segment (—1,1). Let 
u : (A"'",/5) {X,W) be a J-holomorphic map of class L^'^ up to /3 = (—1,1) for some 
p>2. 

The following lemma will prove the case = of Theorem 2 and will be used in the 
proof of the same case of Theorem 3 in the last section. 
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Lemma 3.2 Let J be of class and W be J -totally real of class C^'"" . Let u : — ^ 
{X,W) be J -holomorphic of class C° flL^'^ up to (3. Then u is of class C^'" up to (3. 

Proof. We can assume that W = R" and J{x,y) — Jst = 0(||?/||"). On the trivial bundle 
A"*" xM^" — * we consider the following linear complex structure: Ju(2;)[^] = J{u{z))[^] 
for ^ e M^" and z E A+. At this point we stress that Ju is defined only on A"*" x R^". 
Denote by r the standard conjugation in A C C as well as the standard conjugation in 
M2n ^ (j-n_ j^Q^ extend J„ to A x R^" by setting 

Juizm = -rJuir.M] ^OTZ e A and e e R'". (3.1) 

We consider now m as a section (over A+) of the trivial bundle E = M^" x A ^ A 
and endow E with the complex structure Ju. Complex structure J„ defines a 9-operator 
dj^w = dxW + JudyW on L^'^-sections of for all 1 ^ p < cxd (for this only continuity of 
Ju is needed). Remark that u is J^-holomorphic on A"*". By F we denote the totally real 
subbundle A x R" ^ A of 

Definition 1 Define the "extension by reflection" operator ext : L^{A'^ ,E) 
by setting 

ey.t{w){z) = tw{tz) 
for z G A^ and w G L^{A'^,E). We shall also write w for ext(w). 

Note that if w is continuous up to /3 and takes on P values in the subbundle F then 
ext{w) stays continuous. By the reflection principle of Theorem 1.1 from |IS2] we know 
that ext : L^'P{A'^ ,E,F) L^'P{A,E) is a continuous operator for all 1 ^ p < oo and that 
dj^w = if dj^w = 0. Let u be the extension of u, in particular, u is J„-holomorphic 
on A of class L^'^(A). First a priori estimae (1.1) from [ISlj insures that u G L^^ for all 
p < oo. In particular u eC^ for every 7 < 1. Therefore Ju is of class C^, where 6 = 07. 
Set V = pu, where p is a cut-off function equal to 1 in Ai. Then from (12. 2p we get 

v^- Aj{u)v-^ = g, (3.3) 

where the function g = [p^ — p(^Aj(u)~\ u is of class C^{A). Observe that v^ — Aj{u)v-^ = 
(y — T^'^Aj{u)v-^)-. Elliptic regularity implies that v — T2'^Aj{u)v-^ is of class C^'^ and 

invertibility of the operator Id — T2'^Aj{u)-^ in C^'^ gives that v is in C^'^. 

One can repeat this step once more to get '"-regularity of u on A and therefore of 
u up to p. 

□ 

3.2. Cluster Sets on Totally Real Submanifolds 

Since the case = of the Theorem 2 is already proved, we restrict ourselves in the future 
with k ^ 1. Fix an almost complex manifold {X,J) with J of class C^'" and a J-totally 
real submanifold W of class C^'". Let m : A — > X be a bounded J-holomorphic map of the 
unit disc into X. Suppose that c\{u,P) d W, where /? is some non-empty open subarc of 
the boundary. 



L\A,E) 
(3.2) 
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We use the Proposition 4.1 from jCGSj and observe that u is in Sobolev class L^'^ up 
to /3 for all p < 4. In particular u is C^-regular up to f3 with /3 = 1 — ^ (this means for all 

/3 < |). Lemma 3.2 implies now the following 

Corollary 3.1 Let J e C^-" and W e C^'". If u : (A+,/5) ^ {X,W) is a hounded 
J-holomorphic map with cI(m,/5) d W then u G C^'°'{^^ U (3). 



Let's stress here that C^'" is not the optimal regularity of m, it should be C^'°. This 
will be achieved in the next subsection. 



3.3. Geometric bootstrap and boundary C^^^-^ -Regularity 

Having proved the C^'"-regularity of complex discs in C"-regular structures we are going to 
use the "geometric bootstrap" to obtain C'^"^^'°-regularity of complex discs in C'^'^-regular 
structures. 

We need to lift an almost complex structure from the manifold X to its tangent bundle 
TX. In local coordinates the lift J'^ is defined by 



where are coordinates in the tangent space. This lift is invariantly defined, see |GSj for 
more details. After that we can use the induction on k. Really, if J G C^'°' then G C". 
Further we lift J-holomorphic map m : A X to J'^-holomorphic map u'^ : A ^ TX. 
This lift is defined as 



u^{0 = {u{0,du{0{ei)), (3.4) 

where ei = (1,0). 

Now remark that if ly is a J-totally real submanifold in X then TW is a J'^-totally 
real submanifold in TX. Really let v G T{TW) n J%T{TW)). li v = {vi,V2) in the 
triviahsation T{TX) = TX®TX then vi G TWr}J{TW), implying that Vi = 0. Hence 
V2 G TW n J(TW), implying that V2 = 0. Therefore v = 0. 

Further the lift u'^ : A"*" TX of a J-holomorphic map u : A+ X with boundary 
values in W has its boundary values in TW (this is clear from the formula f l3.4p ). Applying 
Lemma 13.21 to u'^ and TW we prove that the first derivative of u with respect to ^ is of 
class C^'" on A"*" U (3. Here ( = C,+'if]. The J'^-holomorphicity equation 

(3.5) 

implies that ^ is also of class C^'" on A+ U /3. Therefore u G C^'" up to (3. By induction 
we conclude that u is of class C^+'^'°' up to /3 if J G 0'''°' and W is of class 
Theorem 2 is proved. 
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4. Riemann-Hilbert Boundary- Value Problem 

In this Section we develop one of the main tools of this paper - a sort of a Riemann-Hilbert 
problem. This will be used in the proof of Theorem 1. Denote by = {e*^ : 6 G]0,7r[} 
the upper semi-circle. 

For the local conciderations of the present Section we suppose that X = C" and 
W = iM" = {z = x + iy : X = 0} and that J G C^'" is a small deformation of Jst- Fix also a 
Jst-holomorphic map : A — > C" of class L^'^(A), p> 2, such that m°(S^) C iM" (so that 

extends holomorphically to a neighborhood of by the classical Schwarz Reflection 
Principle). For J close enough to Jgt we will establish the existence and uniqueness of a 
J-holomorphic disc u close enough to m° satisfying the boundary condition 'u(S"'") C iM". 

Therefore for J close enough to Jjt we study the solutions of (12. 2p satisfying the 
boundary condition 

ReM|s+ = 0. (4.1) 

Denote by T^'^ the Banach space of (M" -valued) functions (p G T^'^ vanishing on S"*". This 
space is equipped with the standard norm || ip ||ti.p- Set now y?" := Reu°|S and remark 
that (p^ G Tq'^ because Reu°|s+ = 0. We replace the condition (14. ip for the solutions of 
the partial differential equation (12. 2p by the condition 

Reu\s = 'fi, (4.2) 

where cp G Tq'^. Therefore we consider the following boundary-value problem 

u-^ — Aj{u)u-^= 0, 

Reu\s = ^, (4.3) 
lnn«(0) = a, 

for the given initial data (p G Tq'^, a G M"". 

Lemma 4.1 If J is close enough to Jst in C^'°'-norm, then there exists a neighborhood U 
of ip^ in Tq'^ , a neighborhood U' of a? := lmu°(0) in M" and a neighborhood V of in 
L}''P{^) such that for each cp eU and a eU' the boundary problem admits a unique 

solution u eV . 

Proof. Consider the operator 

Lj : L^'^'(A) — > LP{A) x T^'^ x 

defined by 

u-^-Aj{u)u-^ 



Lj : ti I— >■ Re-ul 



s 



Imn(O) 

Lj smoothly depends on the parameter J. Denote by Lj{u) the Frechet derivative of 
Lj at u. Lj is continuous on the couple {J,u) and at Jjt-holomorphic the derivative 
Lj^j(m°) is particulary simple: 
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\ Imu(O) 

Let's see that Lj^^{vP) is an isomorphism. Indeed, given h G Lp(A), if) G T^'^ and a G 
then the function 

u = T^^h -t\m (Tf ^/i(0)) +ta + T^^(^ - Re (Tf ^/i) | S) 

is of class L^'^(A) and satisfies the equation 




Uniqueness of ii is obvious. Therefore by the Imphcit Function Theorem every Lj is a C^- 
diffeomorphism of neighborhoods of in L^'^(A) and of (0,y9o,cio) in ^^^(A) x T^'^ x M". 
Since Tq'^ is a closed subspace of T^'^ the Lemma [4.11 follows. 

□ 

Let us formulate a corresponding statement in Holder classes. Let k ^ 1. Fix a 
Jst-holomorphic map : A — > C" of class C'^"^^'"(A) such that 'U°(S'^) C iM". For 
every positive integer k denote by Cq'"(S) the Banach space of (R"" -valued) functions 
ip G C^'"(S) vanishing on S"*". This space is equipped with the standard norm || ip ||cfc.c(s)- 
Set now if^ := Reu°|S. ip^ G Cq'''^'"(S) because Reu°|s+ = 0. Therefore we consider the 
boundary value problem (14. 3 p for the given initial data ip G Cq^^'"(S), a G M". 

Lemma 4.2 Suppose k ^ 1. If J is close enough to Jst in C^''^-norm then for every 
l^l^k: 

(i) there exists a neighborhood U of p^ in Co+^'"(S), a neighborhood U' of := lm/(0) 
in and a neighborhood V of vP in C'"'""^'"(A) such that for each p &U and a & U' 
the boundary problem lli4-3\ ) admits a unique solution u G V ; 

(ii) the unit disc A can be replaced in part (i) of the present Lemma by any bounded 
simply connected domain VL with C°° boundary and S+ can be replaced by any non- 
empty open arc. 

Proof. The part (ii) follows from (i) by the Riemann mapping theorem and the classical 
theorems on the boundary regularity of conformal maps. For the proof of part consider 
the operator 

Lj : C'+^'"(A) — > C''"(A) X C'+^'"(S) X R'^, 

defined as in the proof of Lemma 14. but this time in other smoothness clases. One can 
literally repeat the arguments used there also in this case. 

□ 
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5. Reflection Principle-II: Real Analytic Case 

Let us turn now to the proof of Theorem 1. We shall proceed in two steps. 
5.1. Small deformations of the standard structure 

Here we consider the case when J is a small real analytic deformation of Jst and W — iR". 
First we introduce suitable Banach spaces of real analytic functions using the complexi- 
fication. 

Denote by = A x A the standard bidisc in C^. We define the space C^'°'{A) con- 
sisting of functions u (or C"-valued maps) of class C^'°(A) with the following properties: 

(i) M is a sum of a power series u{Q — X^fe;iife/C*^C' fo^ C ^ ^■ 

(ii) The "polarization" u oi u defined by ■u(C,0 — Z^w'^fe/C'^C' is a function holomorphic 
on A2 and of class C^'°'(A^). 

(iii) The mixed derivative is of class C"(A^). 
We define the norm of as following: 



C"(A^) 



Since u is the restriction of u onto the totally real diagonal {■C = C}) the polarization u 
is uniquely determined by u and therefore C^'°'{A) equipped with this norm is a Banach 
space. 

Remark 3 One has the following continuous inclusion (9^'"(A) C Cj^'"(A): for u G 
C^'"(A) the corresponding u is simply u{C,^) = u{Q. Really, for such u one has = 0. 

We denote by Cl;°'{dA'^) the space of real functions (p on 9A+ such that there exists 
a function v € 0^'°(A) satisfying the condition Rev|aA+ = f- In particular such function 
(f is real analytic on the interval (—1,1). The holomorphic function v is unique up to an 
imaginary constant so we always assume that Imt'(O) = 0. We define the norm of (p as 
a 0^'°' norm of the corresponding function v on A. Then C^'°(9A"'") equipped with this 
norm, is a Banach space. 

Furthermore, denote by C^'"(5A"'") the space of real continuous functions on ^A"*" 
which are of class C^'° on the closed upper semi-circle and on the interval [—1,1]. Finally 
we denote by Co'"(aA+) the space of real functions of class C^''^[dA'^) vanishing on the 
interval [—1,1]. The following statement is a consequence of the refiection principle. 

Lemma 5.1 For every function ip G Cq'"(9A+) there exists u G 0"'^'"(A) such that 
ReM|aA+ = IiT' particular, the space Cq'"(c?A+) is a subspace of C^'°'{dA~^). 

Proof. Let </? be a function of class Co'"(9A+). Solving the Dirichlet problem for (p in 
the upper semi-disc, we obtain a harmonic function h in A+ continuous on A^ such that 
^|aA+ = ^- Since h vanishes on [—1,1] it extends harmonically on A by the classical 
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reflection principle for harmonic functions. Namely, its extension h* is defined by h*{() = 
—h{() for ( in the lower semi-disc A~. Thus we obtain a function h harmonic on A and 
continuous on A. Since the restriction 99 of /i on the closed upper semi-circle is a function 
of class C^'", it follows easily by the definition of the reflection h* that the restriction 
<f '■= h\gA of h on dA is a function of class C^'"(9A). Then the Schwarz integral T^'^ip 
gives by Proposition 12.21 a function of class (9^'"(A) whose real part coincides with h. 

□ 

Lemma 5.2 If u e Ci'"(A) then Reu\gA+ e C^'"{dA+). 

Proof. Let u(C,0 — Tli'^kiQ^^^ be the polarization of u holomorphic in the bidisc A^ 
(that is u{Q = u{CX) )• Then the function h{() = u{C,C) is of class 0^'°'{A) and 
= ""If-i,!]- Denote b (p the restriction of Re{u — h) to 9A+. Then (p G Co'"(c)A+) 
and by Lemma TS. II there exists a function v G (9^'"(A) such that Rev\dA^ = ip. Since the 
function /i + f is of class (9^'"(A), its real part gives the desired extension of the function 
ReM|9A+. 

□ 

We suppose everywhere below that our almost complex structure J (and therefore Aj 
in the equation for J holomorphic curves) is a real analytic matrix-valued function given 
by a convergent power series Yl'^kiz''^'' with the radius of convergence big enough. The 
equation (12. 2p on A can be rewritten in the form 

{u-T^''Aj{u)u^)^ = 0, (5.1) 

where T^'^ denotes the Cauchy - Green transform on A. Define the map 

$j:C^'"(A)^C^'"(A), 

as 

^j:u^u-T^^Aj{u)u^. (5.2) 

Equation (15.11) means that u is J-holomorphic if and only if $jm is holomorphic with 
respect to Jst- The following lemma explains the choice of smoothness classes in this 
Section and is the principal step in the proof of Theorem 1. 

Lemma 5.3 For J close to Jst the operator $j establishes a diff'eomorphism of neighbor- 
hoods of zero in the space ^^^'"(A). 

Proof. First we prove that $j maps the space C^'"(A) to itself. Given function u G 
C^'"(A) denote the function Aj{u)u-^ by h. We need to prove that T^'^h belongs to 

C^''^{A). Consider the polarization h{(,C,) = h{(,^) of h. By Proposition 12.11 we have the 
representation 

Tf^MC) = i^(C,C)-^/ (5.3) 

where 

H{C,0= f h{C,u)du; (5.4) 
Jim 
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is a primitive of h with respect to ^. Let's study the primitive fl5.4p of h first. We point out 



2 

that the function h is of class C°'"(A ). Furthermore, the condition (iii) of the definition 



of the space C(^'"(A) imphes that dh/d( is of class C°'"(A ). Now the derivation of the 
integral (15.41) with respect to ( and ^ gives that H satisfies conditions (i), (ii), (iii) of the 
definition of the space C^'"(A). 

By Proposition 12.21 the Cauchy integral in the right hand side of (6.3) represents a 
function of class (9^'"(A) and so also belongs to the space C^'^^A). 

Thus we obtain that $j(m) belongs to C^'"{A). Since the Frechet derivative of $j 
with respect to u at m = and J = Jgt is the identity map, the lemma follows from the 
inverse mapping theorem. 

□ 

Hence $j is a diffeomorphism between neighborhoods of zero in the manifolds of J- 
holomorphic and J^rholomorphic maps of class C;^'"(A). In particular, J-holomorphic 
maps form a Banach submanifold in C^'°(A) in a neighborhood of zero. We denote this 
manifold as C^'j(A). 

Remark 4 Note that Ci;KA) = 0^'^{A) and that Oi;j(A) = <l>j(Oi'°(A)) . 

We use the notation O^];,' jq(A) for the submanifold of such u G C^' "(A) that ReM|[_i.i] = 0. 

Its diffeomorphic image under $j we denote as A^j,o := (C^i' jo(^)) • By -RaA+ denote 
"taking real part and restriction to (9A+" operator. One has the following commutative 
diagram: „i 

Ci'"(A) D Oi'"(A) Oi'}(A) 

Ci'-(A) D Mj,o ^ 0:ao(A) Co^'"(5A+) , 

where both is are natural imbeddings. For an unknown map v from O^' jq(A) and given 
If G CQ°'{dA~^) consider the system 



Imt'(O) = a. 



(5.6) 



Fix a Jst-holomorphic map G (9^'°(A) such that Rei;''|[_i i] = and set cp^ = 
Ret;°|aA+- 

Lemma 5.4 For rea/ analytic J close enough to Jst in C^'^-norm there exists a neighbor- 
hood U of (p^ in Cg'°((9A"^), a neighborhood U' of := lmf''(0) in MJ^ and a neighborhood 
V of in C^'"(A) such that for ip E U and a E U' the system \5. 0^) admits a unique 
solution V G \/nC^' jo(A). 

Proof. Setting v = ^j^w we replace (15. 6p by the boundary value problem for an unknown 
map w G A^j,o, i-G., we shall write it as 

RoA+^yw = (p, 

\m^-^w{0) = a. ^ ■ ' 
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At J = Jst that <l>j = Id and Mj^.^ = O^'^iA) := {w e Oi'"(A) : Rew| [-1, 1] = 0}. The 
surjectivity condition for the operator obtained by the hnearization of (15.71) at = 
and J = Jst and of the operator is reduced to the resolution of the following system 

RdA+W = tp, ^^g^ 
Imw(O) = a, 

for an arbitrary given function ip G Cq'"((9A'^), arbitrary a G M" and an unknown map 
w G Oo'"(^)- -By Lemma ETU we obtain a solution for any given right hand side of f lS.Sp . 
The uniqueness of w is obvious. Therefore the linearization of (15. 7p is a bijective operator 
at J = Jst. By continuity it will be bijective from TqA4j^o to Co'"((9A"'") ©M" also for J 
close to Jst. Now the Implicit Function Theorem implies the desired statement. 

□ 



5.2. General case 

Now we prove Theorem 1. According to Theorem 2 (which we will prove in the next 
section) the map u is C°° smooth up to the arc p. We replace the unit disc by the 
upper semi-disc and j3 by the interval (—1,1). By the classical results on the interior 
regularity of pseudo-holomorphic maps we can assume that the map u is real analytic 
in a neighborhood of A"'"\[— 1,1]. Furthermore, the statement is local so shrinking A+ if 
necessary we assume that u is of class C°°{A ). We can also assume that X is the unit 
ball of C" equipped with a real analytic almost complex structure J with J(0) = Jst and 
that W = zM" and u{0) = 0. 

Since our considerations are local, we can reduce them to the case of a small de- 
formation of the standard complex structure. Indeed, our map u admits the expan- 
sion u{() = b( + o{\(\) near the origin. For t > consider the real analytic structures 
Jtiz) = J(tz). They tend to Jst as t tends to 0. Maps m*(C) = t~^u(tQ are J^-holomorphic 
and tend to the map : ( — > b( as t — > which is viewed as a J^t-holomorphic map. 

For t small enough let f * be the solution of the boundary-value problem (15.61) with 
ip* := Reu^\dA~^ given by Lemma [F!^ This solution is unique in the class of solutions real 
analytically extendable past (—1,1). However, this still does not give the desired analyt- 
icity of since this boundary-value problem could admit solutions in other smoothness 
classes of maps. So we need the uniqueness statement of Lemma 14. 1[ Let H : A —>■ A+ be 
a biholomorphic map fixing the points —1 and 1. Then H is of class C^/^(A) and extends 
analytically through the open upper and lower semi-circles. In particular, H G L^'P(A) 
for any p < 4. Since G C^'"(A ) the composition v^oH is in L^'^(A). At the same time 
(p^ o H belongs to T^'^ for every p < A. Applying the uniqueness statement of Lemma [4.11 
we conclude that oH = oH which implies that the maps m* are real analytic up to 
(—1,1) for t small enough. This proves finally that u extends as a real analytic map past 
(—1,1). Since it satisfies the real analytic condition (12.11) on an open set, the extension is 
a J-holomorphic map. This proves the Theorem 1. 
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6 Compactness 

6.1. Compactness theorem: definitions 

We start with recalling some notions and definitions relevant to the formulation of Gromov 
compactness theorem as it is stated in [1S1\ IIS2] . For a more detailed exposition we refer 



to these papers. 

1. Structures. We fix a Riemannian manifold {X,h), a compact subset K X and a 
sequence of almost- complex structures Jn of class C'^'" on X, which converge on K in 
C'^'^-topology to an almost-complex structure J, k ^ 0,0 < a < 1. The latter is supposed 
to be defined on the whole X. Areas of J„-complex curves will be measured with respect 
to the "hermitizations" hj^{-,-) := \{h{- , ■) + h{Jn- , Jn-)) of h (which converge to hj). 

2. Curves. We are given a sequence {C„} of nodal curves with boundary, parameterized 
by the same compact, oriented real surface (S,(9S) with boundary. We suppose that 
some parameterizations (5„ : S ^ (7^ are given as well as some J„-holomorphic maps 
Un '■ Cn ^ X such that {Cn,Un) bccomcs a stable curve over {X,Jn), see Definitions 2.1 - 
2.3 from jIS2] . 

3. Boundedness of areas. We suppose that h j^-areas of m„(C„) are uniformly bounded and 
that Un{Cn) C K for all n. 

4. Weak transversa lity. Let f : W —>■ X he an immersion of class C'^"'"^'" of a real n- 
dimensional manifold W into a real 2?T,-dimensional manifold X and x G f{W) a point 
of self-intersection, so that f~^{x) = {wi, ...,Wd} C W with d ^ 2. We say that fiW) 
has weakly transverse self-intersection in x if there exist neighborhoods UidW oi Wi such 
that for any pair Wi ^ Wj the intersection f{Ui) r\f{Uj) is a C'^^^'^-submanifold in X of 
dimension equal to dim [df{TwW)ndf(T^.W)). 

5. Totally real submanifolds. We fix a collection {M/j}™ of real manifolds of real dimension 
n = dirricX and J-totally real immersions fi '■ Wi ^ X, i=l,...,m, of class We 
call W = {(Wi, fi)}^i the J-totally real immersed submanifold of X. We suppose that 
the immersion / = {/j} has only weakly transverse self- intersections. More precisely 
that means that each fi has only weakly transverse self- intersections and every pair fi,fj 
intersect in the same manner. 

Furthermore, we fix a sequence Wn = {(W^i, /n,i)}i^i of J„-totally real immersed 
submanifolds (with weakly transverse self-intersections), which converge in C^"'"^'"-sense 
to a J-totally real submanifold W = {{Wi, fi)^^} (again, with weakly transverse self- 
intersections!). 

Remark 5 The condition of a weak transverse self-intersection is crucial in applications. 
The reason is that if, for example, a totally real manifold W is immersed into C" with 
transversal self-intersections then its product with, say a circle x 6^ will be immersed 
into C""*"^, but its self- intersections will be only weakly transverse! This construction 
repeatedly occurs in applications. See more about this in |IS2j . 

6. Boundary conditions. We fix a collection of arcs with disjoint interiors f3 = {(3k}kLiJ 
which defines a decomposition of the boundary (9S = Uk/Sk- We assume that every 
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boundary point 6 of S, which is mapped by the parametrization (5„ : S ^ C„ into a 
boundary node a of C„, is the endpoint of two arcs and that a itself is an endpoint for 
four arcs 5n(/5fc) =: Pn,k- Our basic assumption is that the same collection (3 serves for 
all curves C„. Totally real boundary conditions {W,f3, wW) is the data, which includes 
W = {{Wi,fi)}, 13 = {Pk} and continuous maps u^^^ = {uf^ : f3k Wi},i = l,...,m,k = 
1,...,M. Here several different Pk-s could be mapped into the same Wi. 

We shall suppose that the sequence of curves (C„,m„) satisfy the totally real boundary 
conditions {Wn,/3,Un^) in the sense that there are given continuous maps u''^\ : jSk^Wi 
with fn,i o M^^i = , = M„ o 5„ |^^. Here Un^ = {wlf^i}. 

7. Description of convergency. Compactness theorem states that under the assumptions 
described above there exist a subsequence (C„j.,m„j.) which converge in the following sense. 

Definition 2 We say that the sequence (C„,m„) of stable Jn-complex curves over X, 
which satisfies the totally real boundary conditions (Wn,/3,Un'') converges up to the bound- 
ary to a stable J -complex curve {C,u) over X if the parameterizations an '■ ^ ^ Cn and 
a -.T, ^ C can be chosen in such a way that the following holds: 

i) UnOO'n converges to uoa in {11, X) -topology; moreover, Un^ uniformly on con- 
verge to some u^''^ such that {C,u) satisfies the totally real boundary condition {W,f3,u^''^); 

a) if {ttk} is the set of the nodes of Coo and •jk '■= <^~^{cLk) ire the corresponding circles 
and arcs in E, then for any compact subset R d E\Ufc7fc there exists tiq = hq^K), such 
that (j:^^ {{ak}) n K = for all uq and complex structures o'^jc„ smoothly converge to 
cr*jc on R, uq; 

in) on any compact subset R d S\Ufc7fc the convergence UnOUn uoa is in C^+'^'°'- 
topology. 

Note that in this definition it is ad hoc supposed that all Cn-s and also C can be 
parameterized by the same real surface S and that one is allowed to change parameteri- 
zations from initial 6n to an appropriate cr„. Note also that no convergence of itn"*) is a 
priori supposed. It comes as the statement of the Theorem. 



6.2. Generalized Giraud-Calderon-Zygmund Inequality 

Recall the following Giraud Inequality (or estimate): for all 1 < p < oo there exists a 
constant Gp such that for all u G L^(A,C") one has 

LP (A) ■ 

(6.9) 

In Holder norms an analogous statement is due to Calderon and Zygmund. Namely: for 
every < a < 1 there exists Ca such that for all u e C°(A,C") one has 

\\{doTg''){u)\\^^^^^<Co.-\\u\\^^^^y (6.10) 

We shall need the following generalization of (16.91) and (I6.10p to (9-type operators. Let 
J = J(C) be a bounded (resp. C°-continuous) operator in the trivial bundle A x M^" which 



Reflection Principle-II: Real Analytic Case 



17 



satisfies J^(C) = — 'd for all C ^ It defines a natural 9-type operator dj : L^''p{A,M?'^) — > 
XP(A,R2n) (resp. dj : C1'"(A,M2") C"(A,M2")) as follows 

Lemma 6.1 For any p > 2 there exist ep> and C{p, \\J— ^stUj^oo) < oo [resp. for any 
< a < 1 there exist So, > andC{a, H-'^ — -^stlU)) such that for any J G L°° [A, End{R'^'^)) , 
= —Id with \\J — Jst\\Loc(^A) < {I'^sp. any J E with ||J— Jstllc^ < any 
u G ani/ u G C"(A,R^"')) wi/i compact support in A one /ias 

IM«IIlp(a,r2") <C'(p,||J- JstlLoo) |pjw|Lp(A,M2„), (6.12) 

and respectively 

(6.13) 

Proof. For the proof of fl6.12p see Lemma 1.2 in |ISlj . The proof of (16.131) follows the 
same lines. For u G C°'{C,R^") it holds that 

||(ajoTf^-9j,oTf«)«||^„^^^ < 1|J- Jstllc.(A)- ||^(7^f''«)|lc.(A) < 

< ||J- Jst||cc(A)(l + G'a) (6.14) 

where Ga is the constant from (I6.10p . For the standard structure in C" the operator 
dj^oTg^ : C°(A,C") C"(A,C") is the identity. So from flCTD we see that there exists 
= such that if || J- Jst|lc-(A) < then djoTg^ : C"(A,C") ^ C"(A,C") is an 
isomorphism. Moreover, since djoT^'^ = dj^^ oT^*^ + [dj — d j^J oT^*^, we have 



oo 

-1 



[djoTg^Y' = [Id + {dj - djj oTg^] = J^i-midj - oTf (6.15) 



n=0 

This shows, in particular, that {djoT^'-^)~^ does not depend on < a < 1 provided that 

Put h = u — T^^^odj^^u. Then dj^^h = 0. So /i is holomorphic and descends at infinity. 
Thus h = 0, which implies u = {Tcg°9j^Ju. Write 

\\du\\,^^^^^{l + C^)\\dj^,u\\^^^^^ = {l+C^)\^^^^ 

CO 

n=0 

< C{a, II J- Jstllco) ■ , (6.16) 

provided that || J — Jst||(^a < £a- 

□ 
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Corollary 6.1 If Jn J C^'^^-norm on compact i^T d X, A; ^ 0,0 < a < 1, and 
Jn-holomorphic maps Un '■ ^ K X uniformly converge to u : A ^ X then Un converge 
to u in C^^^'" -topology on compacts in A. 

Proof. This will be done in three steps. 

Stepl. -convergence. First we prove the C^-convergency (which is implicitly contained 
in [ISlj ). For this we need only uniform convergence of continuous structures. Consider all 
as a sections of the trivial bundle A x R^" which are holomorphic with respect to the 
pulled back structures J„om„, i.e., dj^ou„Un = 0. Theorem 6.2.5 from [M] implies that 
for every 2 ^ j9 < oo 

ll^n|lLl>P(A(l/2) ^ J„ O ||tfn|lL2(^) , (6-17) 

where the constant Cp(/i( J^om^)) crucially depends not only onp but also on the modulus 
of continuity of Jn^Un- This gives us the boundedness of Un in L^'^(A(l/2)) for all p and 
therefore in for all 7 < 1 by Sobolev imbedding theorem. And the last in its turn 
by the Ascoli theorem implies the C'-convergency for all 7, in particular, for our a in 
question. 

Step 2. 0^'°" -convergence. Take a cut-off function 99 and write using (16.131) (all constants 
below are denoted by the same letter C, but are different): 

||(i[(^(M„-M^)] ^C\\dj^ou„ [p{Un-Um)\ ^ C \\Un - UmWc^ + C \\ipd j^uj\\^^ ^ 

^ C 1 1 tifj Uffi 1 1 ~l~ 1 1 ^ Jm^ Wc II V-"^^»n 1 1 (Jq ^ C* 1 1 li,^ 1 1 ~l~ 

+ C\\JnOUn- Jm° Mm|lcc [ \\d{VUm) |lc« + ll^mllc" ] • (6.18) 

In the same manner from (16.131) we get that 

and the latter is bounded. (I6.18P implies now C ^'"-convergence of m„ to u. 

Step 3. C^^^'"" -convergence. We already lifted an almost complex structure from the 
manifold X to its tangent bundle TX, see (13.41) . Since Un already converge in C^'"- 
topology by Step 2, lifts converge in C"-topology. And therefore again by Step 2 they 
converge in C^'"-topology. The rest is obvious. 

□ 

6.3. Proof of the Compactness theorem 

In |IS2j it was proved that there exists a subsequence which converges as in Definition 
[2] with the only difference that in (iii) the convergence was in L^'^-topology for all p < oo. 
That implies C°-convergence for all < a < 1. We recall that structures J„ in jIS2] where 
supposed to be only continuous and uniformly, i.e., C°-convergent to J. All we need to 
do here is to improve convergence to C'^^^'" in the case when J„ converge in C^'"' and Wn 
in C'^+i'". 

The statement we need is purely local and therefore the totally real manifolds can be 
supposed to be imbedded. P, as before, stays for the interval (—1,1). 
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Lemma 6.2 Let A; ^ and let a sequence {Jn} of almost complex structures of class C'^'" 
converge in C'''"' -topology to J, a sequence {Wn} of imbedded Jn-totally real submanifolds 
of class C''^^'°' converge in C'^+i-"- topology to a J -totally real W , and a sequence Un '■ 
(A+,/3) — > {X,Wn) of Jn-holomorphic maps of class C°nL^'^ converge in C'^HL^''^ -topology 
to u : (A+,/5) — > {X,W). Then Un converge to u in C^'^^''^ -sense up to (3. 

Proof. We start with the case = 0. An obvious modification of Lemma ISTTl provides us 
a sequence {v^"} of C^'"- diffeomorphisms converging in C^'"-topology to ip and such that 
they all satisfy the properties l)-3) stated there. Repeating the considerations of the proof 
of Lemma 13.21 to each J„ and m„ we get a uniform bound on the norms of "extensions by 
reflection" UttnUi^i.^ and this implies the statement of the Lemma for A; = by Corollary 

Having convergency in C^'" topology we obtain the convergency in higher regularity 
classes via geometric bootstrap of subsection 3.3. Really, if J„ — > J in C^'"-topology 
then J'^ in C"-topology. Further we lift J„-holomorphic maps u„ : A ^ X to 

J'^-holomorphic maps u'^: A —>■ TX and apply the case A; = 0. 

□ 

7 Open Questions 

At the end we would like to turn the attention of a reader to some open questions. 

1. Let (X, J) be a real analytic almost complex manifold and W a real analytic J- 
totally real submanifold of X. Let be J-complex curve in X \ W . Does there exists a 
neighborhood V oiW and a J-complex curve C~ inV\W (reflection of C^) such that 
(C+ U C~) n y is a J-complex curve in VI 

For integrable J the answer is yes and is due to H. Alexander, see [X] . 

2. The following question is a particular case of the previous one. Let C be a J-complex 
curve in the complement of a point. Will its closure C* be a J-complex curve? 

3. This question was communicated to us by J.-C. Sikorav. Define a J-holomorphic map 
as a differentiable map m : A — > X such that (12. ip is satisfied at every point. Prove that 
u e L]'^^ (and therefore u is a J-holomorphic map in the usual sense). 
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